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MEASURING PROGRESS IN LEARNING LATIN 



PAUL H. HANUS 

Harvard University 



Purpose of the Present Investigation 

The chief purpose of the present investigation, which is only 
a preliminary study, is to measure the growth of power in three 
elements of Latin assumed to be fundamental — vocabulary, trans- 
lation, grammar; a second purpose is to ascertain what correlations 
exist between these phases of growth. 1 

THE TESTS 

Naturally, the first problem was to develop suitable tests in the 
three fundamentals of language acquisition named above. Since 
the aim is to measure the gain in power in these fundamentals, it 
is obvious that the tests must satisfy two conditions, namely: 
(i) they must be suitable for first-year pupils; and (2) they must 
be applied to the same pupils at about the same time of the year in 
subsequent years. The tests finally adopted are given in Table I 
below. 

It will be seen that the conditions which the tests must satisfy 
were met as follows: 

a) No word appears in the four vocabularies of fifty words each 
which occurs less than one hundred times in Caesar and Cicero. 2 
Our results seem to justify the use hereafter of only one of these 
vocabularies (of fifty words each) instead of all four (two hundred 
words). (For further suggestions on this point, see the summary 
in Table V, at the end of this report.) 

b) The translation test contains only constructions which are 
found at least five hundred times in Caesar and Cicero. 3 

1 Three graduate students working under my direction were assigned to this 
investigation: Messrs. D. H. Fletcher, A. J. Chidester, and J. F. Butterworth. By 
far the greater part of the work was done by Mr. Fletcher. 

2 See Latin Word List, by George H. Browne, Ginn & Co. 

3 See Syntax of High School Latin, edited by Lee Byrne, The University of Chicago 
Press. 
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c) The grammar test consists of questions on the text of the 

translation test. 

TABLE I 

i. City School Class 

2. Pupil's name Age, nearest birthday 

3. This is my year of studying Latin. 

4. Date 



0- 






LATIN VOCABULARY I 






I. 


possum 


14. 


audeo 


27. 


arma 


40. 


invitus 


2. 


dico 


IS- 


capio 


28. 


adulescens 


41. 


liber, -ra, -erum 


3- 


facio 


16. 


homo, -inis 


29. 


adventus 


42. 


maximus 


4- 


do, dare 


17- 


res 


3°- 


aedes 


43- 


in 


5- 


habeo 


18. 


iudicium 


31. 


qui, quae, quod 


44- 


non 


6. 


puto 


19. 


nihil 


32. 


omnis 


45- 


a, ab 


7- 


arbitror 


20. 


castra 


33- 


hie, haec, hoc 


46. 


etiam 


8. 


gero 


21. 


civis 


34- 


nullus 


47- 


ita 


Cl- 


mitto 


22. 


amicus 


35- 


tantus 


48. 


quidem 


io. 


accipio 


23- 


crimen, -inis 


36. 


unus 


49. 


ante 


11. 


cognosco 


24- 


deus 


37- 


quidam 


S°- 


apud 


12. 


constituo 


25- 


acies 


38- 


alter 






13- 


appello 


26. 


annus 


39- 


fortis 












LATIN VOCABULARY II 






1. 


sum 


14. 


animadverto 


27. 


dolor 


40. 


miser, -era, 


2. 


video 


IS- 


censeo 


28. 


aetas, -atis 




-erum 


3- 


videor 


16. 


lex, legis 


29. 


auctor 


41. 


nefarius 


4- 


volo, velle 


17- 


populus 


3°- 


auxilium 


42. 


ad 


5- 


fero, ferre 


18. 


vir 


3i- 


ille, -a, -ud 


43- 


cum 


6. 


venio, -ire 


19-. 


civitas 


32. 


quis, quae, quid 


44- 


et 


7- 


credo, -ere 


20. 


pecunia 


33- 


suus 


45- 


quod 


8. 


intellego, -ere 


21. 


jus, juris 


34- 


aliquis 


46. 


tamen 


9- 


licet 


22. 


genus, -eris 


35- 


noster 


47- 


turn 


10. 


cogito 


23- 


imperium 


36- 


summus 


48. 


at 


11. 


concedo 


24- 


salus, -utis 


37- 


gravis 


49- 


denique 


12. 


conscribo 


25. 


caput, -itis 


38. 


inimicus 


S°- 


igitur 


13- 


accido 


26. 


cupiditas 


39- 


reliquus 












LATIN VOCABULARY III 






1. 


ago, -ere 


7- 


scio, -ire 


13- 


conjungo 


19. 


scelus, -eris 


2. 


debeo, -ere 


8. 


decerno, -ere 


14. 


conor 


20. 


sententia 


3- 


quaero, -ere 


9- 


eripio, -ere 


IS- 


consequor 


21. 


virtus, -utis 


4- 


oportet 


10. 


existimo 


16. 


locus 


22. 


equitatus 


5- 


peto, -ere 


11. 


coepi, -isse 


17- 


modus 


23- 


flumen 


6, 


, relinquo, -ere 


12. 


confiteor, -eri 


18. 


tempus, -oris 


24. 


frater 
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TABLE I— Continued 



25. frumentum 32. bonus 

26. classis 33. is, ea, id 

27. collis 34. vester 

28. comitium 35. alius, -a, 

29. condicio, -onis 36. totus 

30. consuetudo, -inis 37. ullus 

31. tu 38. alienus 



ud 



39. amplus 

40. optimus 

41. parvus 

42. paucus 

43. ut, uti 

44. atque 
45- aut 



LATIN VOCABULARY IV 



1. audio, -ire 

2. judico, -are 

3. soleo, -ere 

4. teneo, -ere 

5. jubeo, -ere 

6. nego, -are 

7. orno, -are 

8. consisto, -ere 

9. contemno, -ere 

10. corrumpo, -ere 

11. cupio, -ire 

12. damno, -are 

13. doceo, -ere 



14. dubito, -are 

15. duco, -ere 

16. animus 

17. bellum 

18. consilium 

19. vita 

20. ager 

21. copia 

22. exercitus 

23. fides 

24. gratia 

25. iter, itineris 

26. laus, laudis 



27. manus, -us 

28. mens, -tis 

29. contio, -nis 

30. corpus, -oris 

31. idem, eadem, 
idem 

32. ego 

33. ipse, -a, -um 

34. ceteri, -ae, -a 

35. quantus 

36. clarus 

37. communis 

38. duo, -ae, -o 



46. vero 

47. ne 

48. per 

49. magis 

50. minime 



39. plurimus 

40. posterus 

41. praeclarus 

42. cum 

43. de 

44. e, ex 

45. autem 

46. modo 

47. nam 

48. propter 

49. sine 
30. contra 



TRANSLATION 
Suggested Credit. 

S 1. Helve tii in Gallorum finibus bellum gerunt. 
S 2. Viri inimicos has tis fugabant. 
10 3. Legatos qui auxilium peterent misit. 
10 4. Hoc facere potuit. 
10 s- Laudari est gratum. 
10 6. Quaesivit ubi esset Caesar. 
10 7. Vereor ne absit 
10 8. Una pars quam Gallos obtinere dictum est, ad inferiorem partem 

fluminis Rheni pertinet. 
IS 9. Gaius Julius Caesar, clarissimus imperator Romanus, librum de bello 

Gallico scripsit, quod ipse in Gallia gesserat. 
15 10. Hoc rumore audito, tantus terror omnium animos occupavit ut ne 
fortissimi quidem proelium committere vellent. 



10 for Each 
Subquestion 



GRAMMAR 

State the case and the reason for using the case: 

(a) Gallorum, sentence 1. 

(b) finibus, " 1. 

(c) hastis, " 2. 

(d) partem, " 8. 

(e) rumore, " 10. 
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TABLE I— Continued 
10 for Each 2 . State the form of the verb and the reason for using the form: 

Subquestion , N 

(a) peterent, sentence 3. 

(b) facere, " 4. 

(c) laudari, " 5. 
(i) esset, " 6. 
(e) obtinere, " 8. 

Printed copies of the tests were given out on the same days to 
the four classes — Freshman, Sophomore, Junior, and Senior (785 
pupils) in seven schools, in as many cities numbered consecutively 
from I to VII. 1 The time required by the pupils to complete each 
test was recorded. We found that ten minutes was ample time for 
each vocabulary; and that the translation and grammar test 
together required from thirty to forty minutes. Our experience 
suggests that in further studies the average time required for each 
test be the time allowed the pupils, and that the results be computed 
on this basis. 

GRADING THE RESULTS 

To obtain an objective standard for grading the results of the 
tests we proceeded as follows: 

a) Vocabulary. — We assumed that all the words of the vocabu- 
lary chosen were of equal difficulty. Naturally this assumption 
should be tested by experiment, and some experiments were under- 
taken for this purpose, as follows: If the words are not of equal 
difficulty, and on the hypothesis that the difficulty of a word 
varies inversely with the frequency of its occurrence, the weight 
assigned to each word of the four vocabularies of fifty words each 
is shown in Table II. In this table the key letters a, b, c, d, e, f, 
g, h, represent the weight given to each word, that is to say, words 
used 1 ,000 times are assumed in the table to represent unit difficulty ; 
hence, words used 500 times represent a difficulty of two units, etc. 
Further, particles used 100 to 200 times or more are called equal 
in difficulty to other words used 400 times. 

On this basis the four vocabularies have the following weights: 
141 units, 163.5 units, 165.82 units, 171 units, respectively. But 

1 Only the pupils in six schools (358 in number) are included in our results. The 
returns from one of the largest schools were received too late to be used in working 
out the correlations. 
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the work has not yet been carried far enough to test the validity 
of this weighting; and, in the results tabulated, we have assumed, 
as has been stated, that all the words in the four vocabularies are 
of equal difficulty. 

TABLE II 

a, words used 1000 times 



b, " ' 


' 500 times 


c, » ' 


' 400 times 


d, " ' 


' 300 times 


e, " ' 


' 200 times 


f, " ' 


' 100 times 


g, particles ' 


' 100-500 times (prepositions, conjunc 




tions) 



h, " " 100-200 times (adverbs, adjectives) 

b) Translation. — So far as I know, no attempts have yet been 
made to secure approximately objective standards for grading 
Latin translations. After several provisional attempts to grade 
the various elements in a Latin sentence, we finally decided to 

TABLE III 





a 


b 


c 


d 


e 


J 


« 


h 


Total 


Vocab. I 

II 

Ill 

IV 


12 
12 

6 
6 


12 
12 
12 
10 


6 
3 
3 

1 


3 
3 
4 
6 


6 
6 

7 
8 


3 
6 

JO 

10 


S 
6 

5 
6 


3 

2 

3 
3 


5° 
S° 
S° 
5° 



Words used 1000 times equal one unit 
" 400 " " 2.5 units 
" " 300 " " 3-33 " 
" 200 " " s.oo " 

IOO IO.OO 

grade only accuracy in rendering into English the ideas contained 
in the Latin sentences; and, after some experiments to determine 
the difference between the grades attained by the pupils, when 
graded on the basis of all the elements of the sentence, and when 
graded by the simpler method which was finally adopted, we chose 
the simpler method because the grades arrived at by the two 
methods were nearly identical. This simpler method consists in 
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grading each idea in the sentence, as a whole, as of unit value. 
If the idea is correctly translated full credit is given; if it is 
not correctly translated no credit is given for that unit. The 
basis of each idea in a sentence is the verb. The sentences 
used in the test contain twenty verbs; hence each verbal clause 
if correctly translated is valued for convenience at five points 
(20X5 = 100). 

c) Grammar. — On the assumption that the grammar ques- 
tions are equal in difficulty ten credits were assigned to each 
question. 

The results of the tests, all reduced to a percentage basis, are 
given in Table IV (p. 348). The terms used in the table explain 
themselves, with the possible exception of "2$q" and "75?." Of 
these, 2517 means the upper limit of the lowest quarter of the class, 
and 755 means the lower limit of the highest quarter. Hence it is 
evident that these measures indicate that one quarter of the class 
had a grade of 255 or below, one quarter 755 or above, and that 
half the class had grades between 255' and 755. 

It goes almost without saying that the percentages given in 
Table IV cannot be used in a comparison of the schools with each 
other, because of the different conditions in different schools. 
Table IV can be used, however, to compare the achievements 
of classes of the same grade in the same schools in successive 
years. 

But the chief purpose of this study would not thereby be 
attained, namely, measuring the growth in power in the Latin 
language of individual pupils. For this purpose the individual 
records of the children obtained this year must be compared with 
their records at about the same time in successive years; and the 
way has been prepared for such comparisons. 

CORRELATIONS 

Correlation sheets showing the correlation of the grades in the 
three tests, vocabulary, translation, and grammar, were prepared 
(1) for each school separately; and (2) for the schools combined, 
so far as the returns were available at the time when the work was 
done. Since the returns from one of the largest schools were not 
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ready at that time, this summary pertains to only 358 pupils. The 
correlation sheets show that 52 per cent of the pupils fall in the 
same third of their respective classes, in both grammar and transla- 
tion, and also in both vocabulary and translation. We find also 
that one-third of the entire number fall in the same third of the 
class (the same tertile) in all three subjects. 

Perfect correlation, as the expression is used in this paper, would 
require that the same individuals who were in the first tertile in 
grammar should also be in the first tertile of the class in both trans- 
lation and vocabulary; in the same way, the individuals who make 
up the second and third tertiles in any one subject must be the same 
who are included in the corresponding tertiles in the other two 
subjects. Also perfect correlation in any two of these subjects of 
course means for any pupil that he is in the same tertile in both 
of them. 

Arranging the correlations found in tabular form we have : 

TABLE V 



I. Perfect Correlation in All Three 
Subjects 

52 were in the first third of the class in all 
three subjects. 

20 were in the second third in all three sub- 
jects. 

41 were in the third third in all three sub- 
jects. 

113 or almost one-third of the class show 
perfect correlation. 



Out of 358 pupils. 



Out of 358 pupils. 



II. Perfect Correlation in Grammar 
and Translation 

78 were in the first third of the class in 

grammar and translation. 
45 were in the second third. 
65 were in the third third. 

188, or 52.5 per cent, show perfect correla- 
tion in these two subjects. 
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Out of 358 pupils. 



Out of 358 pupils. 



TABLE V— Continued 

III. Perfect Correlation in Vocabulary 
and Translation 

77 were in the first third of the class in 

vocabulary and translation. 
46 were in the second third. 
66 were in the third third. 



189, or 52 . 8 per cent, show perfect correlation 
in these two subjects. 

IV. Perfect Correlation in Vocabulary 
and Grammar 

64 were in the first third of the class in 

vocabulary and grammar. 
44 were in the second third. 
63 were in the third third. 

171, or 47 per cent, show perfect correlation 
in these two subjects. 



GENERAL SUMMARY 

i. The purpose of the foregoing study is to measure the growth 
of power in Latin, and to discover the correlations of this power in 
three phases of language-study — vocabulary, translation, and 
grammar. 

2. For this purpose a test in vocabulary, translation, and gram- 
mar has been devised, to be applied to the same pupils at about the 
same time in successive years. Further experiments with the 
vocabulary test are needed to determine whether a single list of 
fifty words is sufficient; and whether the words chosen are of 
approximately equal value. 

3. The grading of the translation and grammar results has been 
tested and has thus far justified itself; but further experiments with 
these tests are needed to reach a definite conclusion on this point. 

4. Table IV may be used to determine the relative achievements 
of classes of the same grade in the same schools in successive years. 

5. But the chief purpose of the tests will be achieved only by 
comparing the records made by individual pupils in successive 
years. 
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6. The correlations of the grades of individual pupils must be 
studied to diagnose individual aptitudes and deficiencies. The 
bearing of such diagnoses on teaching is obvious. 

7. The correlation study covers, as yet, so small a number of 
cases that generalizations as to the relative emphasis the three 
fundamentals of language acquisition demand for satisfactory 
growth would be premature; but further study should throw light 
on this question. 

8. The whole study is a first attempt in a new field; is con- 
fessedly tentative; and the conclusions arrived at are wholly 
provisional. 



